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Summary.  Discrete-Time  Spectral  Estimation  of  Continuous-Time  Processes 
The  Orthogonal  Series  Method. 

Let  {X(t),-«xt<«}  be  a stationary  time  series  with  spectral  density  func- 
tion 4>(A).  Let  {tn>  be  a stationary  Poisson  point  process  on  the  real  line. 

The  existence  of  consistent  estimates  of  4>(A)  based  on  the  discrete-time  obser- 
vations (X( tn ) }p_-| » when  the  actual  sampling  times  are  not  known,  has  been  an 

« 

open  question  (Beutler  (1970)).  Using  an  orthogonal  series  method,  a class  of 
spectral  estimates  is  considered  and  its  uniform  and  integratedly  uniform  con- 
sistency in  quadratic  mean  is  established.  Rates  of  convergence  are  estab- 
lished and  are  compared  with  the  optimal  rates  of  the  available  (Bril linger 
(1972),  Masry  (1978))  kernel -type  estimates  based  on  the  observations 
{X(tn),tn>n=r 


I 


1.  Introduction  . There  is  an  extensive  literature  on  the  subject  of 
spectral  estimation  of  continuous  and  discrete  parameters  time  series.  Here 
we  are  concerned  with  the  estimation  of  the  spectral  density  function  <f>(A)  of 
a time  series  X = {X(t),-<*xt«»}  based  on  the  discrete-time  observations 
{X(tn),y,  where  the  sampling  process  {tn>  constitutes  a stationary  point 
process  on  the  real  line.  Bril linger  (1972),  in  his  fundamental  work  on  the 
spectral  analysis  of  stationary  interval  functions,  discussed  the  consistency 
and  asymptotic  normality  as  T-*-®  of  kernel-type  spectral  estimates  <j>T(A)  based 
on  the  modified  periodogram 

(1.1)  IT(A)  = ||/Te"itXX(t)dN(t)  2 - /T  X2(t)dN(t)| 

where  N(t)  = N((0,t])  is  the  counting  process  associated  with  {tn>.  Considering 
<J>y(A)  as  an  estimate  based  on  discrete-time  observations,  it  clearly 
employs  a random  sample  size  N(T).  Assuming  a deterministic  sample  size  N, 

A IJ 

kernel-type  spectral  estimates  if»N(A)  based  on  the  observations  {Xfy.y^j , 
where  N is  a positive  integer  and  (tn } is  a stationary  Poisson  point  process, 
have  been  considered  by  Masry  (1978)  where  their  pointwise  consistency  in  qua- 
dratic mean  as  N-*-®  is  derived;  yx)  is  based  on  the  modified  periodogram 

<’-2>  J»(*>  = HR  {|  j,  e',tnX*M2  - J,  x2(tn)}  • 

For  a Poisson  sampling  process  {tn>,  the  second  order  statistics  of  J^(X)  and 
Iy(A)  are  distinct  but  the  second  order  statistics  of  the  corresponding  kernel- 
type  estimates  ^(A)  and  <J>y(A)  are  virtually  identical,  as  shown  in  [5J. 

The  above  estimates  require  the  knowledge  of  the  actual  values  of  the 
sampling  instants  ftn }p_-|  (to  evaluate  e1tnX)  in  addition  to  the  data  sequence 


‘•’.tr*  t '*’-  ■*■'**-* 
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{X(tn)^r  This  paper  investigates  the  estimation  of  4>(A)  on  the  basis  of 
the  data  sequence  (X(tn ) }n=-j  alone,  i.e.,  when  the  actual  sampling  instants 
are  not  known.  (Such  a situation  may  arise  in  randomly-sampled  data  systems 
where  the  actual  sampling  times  are  not  transmitted.  See  also  Gaster  and  Roberts 
(1975)  for  examples  in  fluid  mechanics.)  Clearly,  the  peri odogram  approach  (1.1 ) - 

(1.2)  is  no  longer  applicable.  In  fact,  the  existence  of  consistent  estimates  of 
4>(A)  under  these  circumstances  has  been  an  open  question  as  noted  in  Beutler 
(1970).  This  paper  resolves  this  question  when  the  sampling  process  (t^  is  Poisson: 

/v 

By  employing  an  orthogonal  series  method,  a class  of  spectral  estimates  <fy(A)  is 
introduced  and  its  uniform  consistency  and  integrated  uniform  consistency  in 
quadratic  mean  is  established.  The  approach  is  similar  to  the  one  used  by  Cencov 
(1962),  Schwartz  (1967),  Watson  (1969)  and  Rosenblatt  (1971)  for  probability 
density  estimation.  However,  unlike  these  works,  the  complete  orthogonal  set 
in  used  for  the  representation  of  <j>(A),  cannot  be  arbitrary  and  is,  in  fact, 
generated  by  the  statistics  of  the  sampling  process  {tn>. 

In  Section  2,  the  series  representation  for  <|>(A)  is  introduced  and  some 

A 

preliminary  results  are  given.  Conditions  for  the  consistency  of  4>n(a)  and 
bounds  on  the  two  types  of  errors  are  established  in  Section  3.  These  results 
are  compared  in  Section  4 with  the  optimal  convergence  properties  of  the  estimates 
based  on  the  periodogram  (1.1)  or  (1.2).  The  comparison  indicates  that  the  ortho- 

A 

gonal  series  estimate  4>n(A)  has  appreciably  slower  rates  of  convergence.  The 
proofs  are  collected  in  Section  5.  The  question  of  whether  these  rates  are  the 
best  possible  remains  open. 


2.  Preliminaries . Throughout  this  paper,  X = {X(t),-®<t«»}  is  a real 

stationary  measurable  fourth  order  process  with  mean  zero,  continuous  covariance 

function  C(t)€  spectral  density  <p(A)  = (2ir)‘1/°°  C(t)  exp[-itA]dt  and  fourth 

-00 

order  cumulant  function  Q(u-|  .Ug.u^,).  The  sampling  process  {tn } is  assumed  to 


2 
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be  a stationary  Poisson  point  process  on  [0,°°),  independent  of  X,  with  known 

mean  intensity  B,  i.e.,  tQ  - 0 a.s.,  tfl  = tfl _-j+  Tn,  n = 1,2 where  the  Tn's 

are  independent  identically  distributed  random  variables  with  exponential  dis- 
tribution F(x)  = [1  - exp(-Bx)]. 


> 


The  basic  idea  of  the  paper  is  to  employ  an  appropriate  orthogonal  series 
representation  for  <J>(\)  whose  coefficients  can  be  estimated  from  the  data  se- 
quence {X(tR ) }p_-|  alone.  Note  that  if  { Up ( X ) ^ is  an  arbitrary  complete 


orthonormal  set  in  i.2(~, -),  then  *(A)  = J b U(x)  in  L0,  b = O(X)  U*(X)dX 

n=l  " n ^ n I®  n 

and,  as  in  probability  density  estimation  by  orthogonal  series  [3][9][12],  one 
could  estimate  bp  by  bn(N)  = (1/6)  /°°JN(X)  U*(X)dX,  where  JN(X)  is  given  in  (1.2). 

— oo 

Then 


N , *, 

bn(N)  = (1/2TT6N)  y X(tj)X(tk)  u^tj-t^ 
j,k=l 
j^k 

where  u (t)  = f°  exp[itX]  U (X)dX.  Thus,  b (N)  requires  the  know- 
n 

||J 

ledge  of  the  sampling  instants  {tn)n_-|  in  addition  to  the  data  sequence 
{X(tk)}k=r  Hence»  the  basis  {Un (X>)  cannot  be  arbitrary  for  our  purposes. 

Next  we  note  (Shapiro  and  Silverman  (1960))that  the  discrete-parameter  process 
(X(t.)}  has  mean  zero  and  covariance  sequence  (c  } 

(2.D  cn  = E[X(tk+n)X(tk)]  = /“C(t)fn(t)dt,  n * 1,2,... 

where  fn(t)  = B[(8t)n_1/(n-l )!]  exp(-pt),  n.=  1,2,...  . The  set  (fn(t)}  Is 
complete  in  L^(0,«>)  and  its  orthonormalization  yields 

V 

(2.2)  gn(t)  = /26  L^tfflt)  e'6t  l[0>ee)(t),  n - 1,2,..., 

th  n 

where  L_(t)  is  the  rF2-  Laguerre  polynomial.  Note  that  £10J  g_(t)  * [ 0_  k fk(t) 
n n )c*l  ^ 
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where 


(2.3)  enk  ■ /27S  (-2)k_1  (J:]). 

00 

Since  C(t)€  L9(-®,®),  we  have  the  L?  expansion  C(t)  ■ Y a„  gfltl)  where 
* n«l  n n 


(2.4)  a = /°°C(t)g  (t)dt  * l 6 . ck 
n o n k*l  n,K  K 


Hence 


(2.5)  0(A)  = l a G (A) 

n=l 

in  Lgt”00*®)  v^e^e*  by  direct  Fourier  transform  of  (2.2), 

(2.6 ) G (A)  ■ i-  f e-it>  (|t|)dt  = . cos[(2n-1)Un~V/ 

n cn  n " i w'  q 


n = 1,2,... 


{Gn(A)}“,i  is  complete  and  orthogonal  in  I^-®,00)  with  respect  to 
even  functions  on  (-®,«).  The  series  expansion  (2.5)  has  been  considered  by 
Shapiro  and  Silverman  (1960)  in  connection  with  a concept  of  "alias-free"  samp- 


ling. 


N 

The  approach:  Given  the  data  sequence  {X(tn)>^_^  estimate  cn  by 

( If  X X(tk«,X(V-  1 1 » < N 


(2.7)  cn(N)  = 


, N * n 


Then,  via  (2.4),  estimate  the  expansion  coefficient  an  by 

(2.8)  •>)  ■ ^ en>k  ik(N)  , 

and  finally,  estimate  0(A)  by  ; 

00 

(2.9)  L(A)  - l Yn(N)  an(N)  Gn(A) 

where  (yn (N)>  is  an  appropriate  averaging  sequence  to  be  specified  below. 


MMU 
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A bound  on  the  rate  of  decay  of  (a^  is  needed  and  is  given  below; 

AC  [OH  denotes  the  set  of  functions  which  are  r-times  absolutely  continuous 
on  [OH. 

LEMMA  2.1.  For  t s 0,  let  C(t)  € ACr_1[0,<»)  such  that 

(2.10)  tr/2  C(k)(t)  € l2(0,oo)  for  k = 0,1 r. 

Then  for  n = 1,2,... 

|a„l  * A,(r)  n'r/2 

where 

A,(r)  . J-  nt^2  £ CC(t/28)e-‘/2]||L2(0j„). 

REMARK.  The  hypothesis  of  Lemma  2.1  does  not  require  the  differentiability 

of  C(t)  at  the  origin.  Thus,  the  spectral  moments  of  <p(X)  need  not  exist.  For 
example,  C(t)  = e"^  satisfies  the  hypothesis  of  Lemma  2.1  for  every  integer  r * 1. 
Similarly,  if  <f>(A)  is  a rational  function  in  X,  then  Lemma  2.1  holds  for  every 
integer  r * 1 . 


In  investigating  the  convergence  in  quadratic  mean  of  the  estimate  (2.9  ) 
for  a fixed  X,  the  pointwise  convergence  of  the  L2  expansion  (2.5)  is  needed. 

We  have 


LEMMA  2.2.  Assume  C(t)  satisfies  the  hypothesis  of  Lemma  2.1  for  some 
r>2.  Then 

(2.11)  <J>(A)  = l a G (A) 

n=l  n n 

uniformly  on  ( -oofoo)  # 


of  the  estimates  cn(N)  and  an(N).  The  following  assumption  is  needed. 


ASSUMPTION  3.1.  The  process  X satisfies 
(i)  tC(t)  € L2(-~,“>) 

(ii)  |Q(u] ,u2.u3) | * h(uru2,u3) 

where  h is  even  and  nonincreasing  on  [0,®)  in  each  variable  such  that 

f°  h(0,u,0)du  < ®. 

•00 
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THEOREM  3.1.  Under  Assumption  3.1,  the  estimate  cn(N)  is  consistent  in 
quadratic  mean  with 

(D  E[^n(N)3  = (1  - J)c„ 

(11)  »ar[cn(N)]s  A„/N 

where  A2  is  a constant  independent  of  n and  N. 

/\ 

Before  considering  the  consistency  of  the  estimate  an(N) , we  note  that  the 
mapping  (2.4)  of  {cn>  to  {an>  is  unbounded  in  since  Z^=1  0n  k = /2/B(-l )n_1 

but  Ek-llen.kl  = m 3"'1-  Thus>  s1nce  VarC»„(N)]  - e„,k  en,t 

A A A 

cov[c. (N),c0(N)],  a small  variability  in  the  estimate  c (N)  is  likely  to  pro- 

duce  a large  variability  in  the  estimate  a_(N)  for  large  n.  A simulation  study 

■ 

in  [4]  appears  to  confirm  this  observation.  We  have 

THEOREM  3.2.  Under  Assumption  3.1  the  estimate  an(N)  is  consistent  in 
quadratic  mean  with 

(i)  E[an(N)]  =an-(l/N)[n  an-(n-l Ja^] 

(ii)  Var[an(N)]  ^ A3  ^j- 

where  A3  = 2A2/98  . 


Consider  now  the  class  of  spectral  estimates  d>N(x)  defined  by  (2.  9 ),  where 
the  averaging  sequence  (Vn(N)}  is  of  the  form 

(3.1)  yn(N)  = h(ean/Nb)  , a > Jin  3 , 0<  b < ^3 

and  h(u)  is  a real  even  function  on  the  real  line  satisfying 

(i)  | h(u) | * h (0)  = 1 for  all  u, 

(3.2)  (ii)  |uh(u) | s K1  for  |u|  * 1, 

(iii ) l-h(u/  * K2|u|  for  all  u . 

The  kernel  fYn(N)}  is  then  of  the  exponential  type  as  defined  by  Parzen  (1958). 
The  choice  of  exponential -type  kernel  (rather  than  algebraic)  and  the  conditions 
on  the  parameters  a and  b are  necessitated  by  the  variance  expression  of  an(N). 

THEOREM  3.3.  Assume  X satisfies  Assumption  3.1  and  the  hypothesis  of 
Lemma  2.1  for  some  r>l.  Then  the  estimate  (2.9  ) is  integratedly  uniformly 

cbnsistent  in  quadratic  mean  with 

E fliNU)  - d>( A ) 1 2dX  * B^l/in  IJ^dMD) 

■00 

where 

Bj  * 4 A2(r)(2a/b)r~V(r-l ) . 

Next  we  have 

THEOREM  3.4.  Assume  X satisfies  Assumption  3.1  and  the  hypothesis  of 
Lemma  2.1  for  some  r >2.  Then  the  estimate  (2. 9 ) Is  uniformly  consistent  in 
quadratic  mean  with 

E|JN(A)  - <t.(A)|2  * B2[l/Jin  N]r_2(l+0(1)) 

uniformly  in  A,  where 

B2  * ( 32/ ir2$ ) A2  ( r ) ( 2a/b ) r”2  ( r-2 ) ”2  . 


s nmrsf 
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4.  Discussion.  We  first  establish  the  optimal  convergence  properties 


of  the  kernel -type  estimate  ^(X)  based  on  the  periodogram  (1.2).  i|»N(x)  is 
of  the  form  [2][5] 


(4.1)  *N(X)  = (1/8)  / WN(X-ji)  JN(y)dy 


where  WN(X)  = MN  K(MNX),  M^  + oo  and  Mn/N-*0  as  N-^«>  and  the  kernel  K(X)  is  a 
real  even  continuously  differentiable  function  on  (-<*>,<»)  satisfying 


(i)  sup  | K( X ) | < « 
-°°<\<°° 


(ii)  sup  | K* (X) | < * 

-oo<X<oo 


(4.2) 


(iii)  / | K(X) |dX  < oo 


(iv)  / K(X)dX  = 1 . 


Aside  from  the  conditions  on  the  fourth  order  cumulant  (Hu^^.u^)  we  have  by 
[5],  Theorems  1 and  3 (or  [2],  Theorem  4.3),  that  if  tC(t)  € (-00,00)  then 

~ 00 

E[^(X)]  = / WN(X-y)<J>(y)dvi  + 0(1/N) 


Var[JN(X)]  - 27r6(MN/N)  [«J>(X)  + (l+6fl  J / K2(u)du(l  + o(Mn/N))  . 


To  find  the  optimal  convergence  properties  of  ^N(x)  we  proceed  as  in  Wahba 
(1975).  Assume  that  for  some  integer  r*  1 , K(X)  satisfies  in  addition 


(4.2) 


and  that 


(v)  / XjK(X)dX  = 0,  j = 1 r-1 


(vi)  / | X | r | K(X) | dX 


> 


Expanding  <J>(A+y)  in  a Taylor  series,  and  using  (4.2 ) (iv)-(vi ) in 

/ K(-u)4>(A+u/MN)du,  we  find  b2[>N(A)]  * B3  Mjj2r(l  + o(l)) 

-00 

where 

B3  — 7 [/  |u|r|K(u)|du]  [/  |t|r|C(t)|dt|  . 

[2irr!]  -<*>  l-00  -* 

Thus,  ignoring  a factor  (1  + o(MN/N))  in  the  variance  and  (1  + o(l))  in  the  bias, 
we  have 

(4.4)  E|JN(X)  - <t>(A) |2  s B3  M'2r  + B4(Mn/N) 
where 

B4  - 4ttb[/  |C(t)|dt+^-j  / K2(u)du  . 

— OO  .00 

Then  choosing  MN  = [2rB3/B4]1/(2r+1 ) NV(2r+l)  ^ which  min1mizes  the  right-hand 
side  of  (4.4),  we  have  finally 


(4.5) 

where 


EkNU)  - «(.<>.) 1 2 s B5  N"2r/(2r+,)(l  + „(1)) 


[B3B2r]^<2r+|)  . 


The  parameter  r of  (4.3)  and  Lemma  2.1  represents  a degree  of  smoothness 
of  <f>(A).  For  the  same  value  of  r,  the  hypothesis  of  Lemma  2.1  is  generally 
more  restrictive  then  (4.3),  even  though  (4.3)  implies  (2.10)  with  k = 0. 

For  the  same  value  of  r,  the  mean  square  error  of  the  estimate  JN(x)  is 
0(1/N2r^2r+1 ))  whereas  for  the  series  estimate  <j>N(x)  it  is 
0(l/[fcn  N]r  2]  by  Theorem  3.4.  Thus,  ^(A)  has  an  appreciably  higher  rate  of 
convergence— this  at  the  expense  of  requiring  a record  of  the  sampling  instants. 


Comparison  or  the  basis  of  mean  integrated  square  error  cannot  be  made 
since  the  kernel-type  estimate  (4.1)  has  not  so  far  been  shown  to  be  consis- 
tent in  this  sense  (see  [2][5]). 

The  proofs  of  Theorems  3.3  and  3.4  indicate  that  the  logarithmic  conver- 

/V 

gence  rates  of  the  series  estimates  <p^(X)  are  du*.  to  the  exponential  growth  in 

A 

n of  var[an(N)]  as  given  by  the  bound  in  Theorem  3.2.  The  discussion  pre- 
ceding Theorem  3.2  provides  evidence  for  such  a rapid  growth.  It  remains  an 
open  question  whether  the  convergence  rates  of  the  series  estimate  obtained 
here  are  the  best  possible. 


Finally,  we  note  that  when  the  sampling  process  {tn>  is  not  necessarily 
Poisson  but  "alias-free"  in  the  sense  of  [1]D0],  an  orthogonal  series  estimate 
of  4>(X)  of  the  form  (2.9  ) can  be  considered  in  a similar  fashion.  However, 
the  analysis  becomes  more  complex  since  the  basis  {gn(t)}”=1  is  generated  by 
the  statistics  of  the  point  process  (tn).  (In  the  Poisson  case,  we  have  the 
Laguerre  functions  (2.2),  whose  properties  are  well  known.) 


5.  Proofs. 

Proof  of  Lemma  2.1.  The  following  relationship  for  generalized  Laguerre 
functions  is  easily  verified. 


(5.D  tv-^;](t)  = ^[TS|lrr  . 

By  repeated  substitution  of  (5.1)  and  integration  by  parts  in  the  integral  below, 
we  have 


(5.2)  JA  C(t/2B)  L ,(t)e"t/2dt 
0 n_l 


r-1  (-l)ktk+1Lk+](t) 


l 

k=0 


-n-1 

n(n+l ) . . . (n+k) 


d"  [C(t/2B)e~t/2] 


5? 


1A 

J0+ 


+ 


n(n+l ) 


i 


ii  ; 


1 1-1  u . ' ...  l : ■ — ■— r — 
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Each  term  in  the  sum  vanishes  at  infinity  by  the  hypothesis  of  Lemma  2.1. 
Finally,  by 


ll‘r/2  *-t/2llt2(0.»)  - C^1/2- 

the  dominated  convergence  theorem  and  the  Cauchy-Schwarz  inequality 

in  1 1 • ^ A*  (r) 

l*nl  ‘ Vr>  CtMttI  s77T- 

Proof  of  Lemma  2.2.  By  (2.6)  and  Lemma  2.1, 

z”_i  |an|  |Gn(X)  | £ (2/tt2B)1  e“=1  | an | < o°.  Since  Gn(X)  is  continuous,  the  series 

in  (2.11)  converges  uniformly  to  an  even  continuous  function,  say,  \p(X).  Since 

p 

z“_-|  | an | < °°,  ip(X)  € L2(-°°,«>)  by  the  Riesz-Fischer  theorem  and  hence 

/3x>C<p(X)-ip(X)]Gn(X)dX  = 0,  n = 1,2,...  . Finally,  since  (Gn  (X)}“=1  is  com- 
plete in  L2(-oo,o°)  with  respect  to  even  functions,  we  have  <J>(X)  = >Kx)  a.e. 
and  the  result  follows  by  the  continuity  of  <p(X)  and  i^(X). 

Proof  of  Theorem  3.1.  ( i ) is  clear.  For  (ii),  we  have 


where 


Var[cn(N)]  = J TnJ(N)  - E2[cn(N)] 

T"-,00’7iX  • 

Tn,2(N>  =?kj!,E[C(trt)C(WVn>]' 

Tn,3(N)  ’ EtC<t«*-n‘tk)C(tk+n'te^  • 

Tn,«*N'  “ i?  k J.iE^tk*n'tk,Vtk,tt*n‘tk^  • 


By  a bounding  argument  similar  to  the  one  employed  in  [5],  it  can  be  shown  that 
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••  ■ ■ - - - 


-- * . 


n 


i 


A 

if  tc(t)  € L2(-°o,oo)  then  |Tnj(N)  - E2[cn(N)]|  * -j^-  , 1f  C(t)  € L}(— ,«)  then 

lTnj(N)|  * , j ■ 2,3,  and  If  Q^.Ug.Uj)  satisfies  Assumption  3.1  , 

then  |Tn  4(N)|  * A2yN,  where  A2J,  j - U2.3.4  are  constants  Independent  of 

n and  N.  The  result  (ii)  follows. 

Proof  of  Theorem  3.2.  (i)  By  (2.8),  Theorem  3.1  and  (2.4), 

E[an(N)]  = an-(l/N)  z£_-|k  6n  kck  . Thus  the  bias  b[an(N)]  is 

(5.3)  b[a  (N)]  = - ( 1 /N ) /°°C(t)qn(t)dt 
" 0 

where 

■ j,*  !,,.*<*>  ■ ^ (nk')(-2M)k  e-M- 

Using  the  properties  of  the  Laguerre  functions  [7, p.299]  it  can  be  shown  that 
qn(t)  = n 9n(t)  - (n-l)gn-1(t)  and  the  result  follows  by  (5.3). 

(ii)  We  have  Var1/2[an(N)]  ^ zk=i  len  klVarl/2£ck(N)3  and  the  result  follows 
by  Theorem  3.1  and  £k=1|en>kl  = 3n_1 . 

Proof  of  Theorem  3.3.  We  have 

E r kN(X)  - 4>(X) |2dX  = r b2[L(x)]dX  + P Var[L(X)]dX 

—00  -00  -00  ^ 


where  by  Theorem  3.2 

(5.4)  T » [fK(X)]dX  - j I Un[l-yn(N)]  + -L—  [n  an-(r-l)an.,]}2  , 
and 

(5.5)  rVar[JN(x)]dA  = 1 J y^(N)  Var[an(N)]. 

-»  n=l 

The  truncated  sum  in  (5.5)  at  M,  the  integer  part  of  (b/a)  Jin  N,  is  0(N"P), 
p = l-(2b/a)  tn  3,  by  Theorem  3.2  and  (3.2i);  and  by  Theorem  3.2  and  (3.2ii) 


i 


A k 
H3  l 


9A„ 


the  tail  sum  is  also  0(N’P).  In  fact, 

(5'6)  r Var[JN(A)]dX  * DlN-p;  D1  = -"e-"2 (i-An3 ))  + ST  * 

Next  (5.4)  is  bounded  by  (1/tt) (S-j  + S2  + S3)2  where 

s>  * j,  .4-$ l • s3  ■ i j.  -Mrtoos*  • 


S1  is  the  dominant  term  in  the  integrated  bias,  for  with  M as  before,  we  have 

by  (3.2i)  and  (3.2ii)  and  an  argument  similar  to  the  one  above  that 

s (l/2)(b/a)2|  | C 1 Un  N/N)2(l+o(l)),  k = 2,3.  Now  for  any  integer  m>l,  we 

have  by  (3. 2i ) , (3. 2i i i ) and  Lemma  2.1  that 

..,2 

-2  ^ /.  /o\  i/2 


S,  * 


2 _2am  „-2b  . 4Al(r) 


] - (1/2)  K‘  ||C||‘  e N + 


1 


r-1  ‘ 


2 m 

The  optimal  m which  minimizes  the  right-hand  side  is  then  the  solution  of  a trans- 
cendental equation  and  cannot  be  found  explicitly.  However,  m is  essentially 
logarithmic  in  N and  upon  choosing  m-1  to  be  the  integer  part  of  (b/2a)&n  N,  we 
have 

D r-l 

(5.7)  A2tiN(A)]dX  * — jj  , (l+o(D),  D2  ■ 4AZ(r)  . 

The  result  follows  by  (5.6)  and  (5.7). 

A 

Proof  of  Theorem  3.4  . By  Lemma  2.2  and  Theorem  3.2,  the  bias  of  <fy(A)  is 

b[JN(X)]  = - J an[l-Yn(N)]Gn(A)  -(1/N)  J Yn(N)[n  an-(n-l Ja^jG^A) 
n=l  n=l 

and  by  (2.6)  b[d^(A)]  £ (2/tt26)^2  (Zj  + Z2)  unifonnly  in  A,  where 

Z1  ' j,  lanlC'-v„(N)], 

z2  =(,ZN>J,  " lanl[lr„(N)|  + |yn+)(N)|]  . 
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is  the  dominant  term  in  the  bias,  for  with  M the  integer  part  of  (b/a)tn  N, 


the  truncated  series  at  M in  Z ^ is  0(tn  N/N)  by  (3.2i)  and  Lemma  2.1,  and  the 
tail  sum  is  c(N(tn  N)1_r^2)  by  (3.2iii).  Next,  for  any  integer  m>l , we  have 


by  (3.2i)(3.2iii)  and  Lenina  2.1  that 


*2*1  (r)r  „ 4*i  (>*)  ,.(r/2) 

Z1  (r-2)  ' N e * 


and,  by  an  argument  similar  to  the  one  employed  for  of  Theorem  3.3,  we  find 
(5.8)  b[JN(X)]  * D3Un  N)(2'rJ/2(l+o(l));  D3  = 4^ (r)(b/a)1  "(r/2)/(r-2) . 

For  the  variance  we  have  by  the  Cauchy-Schwarz  inequality  and  (2.6)  that 


V«r[>„(X)]  s (2/*2b)  [ l |y„(N)|  var'/2[a  „(N)]]2  . 


KN' Vl"n 

Again,  with  M the  integer  part  of  (b/a)£n  N,  the  truncated  sum  at  M is 


0(N-P/2),  p=i  - — An  3,  by  Theorem  3.2  and  (3.2i);  whereas  the  tail  sum  is 


O(JH)  by  Theorem  3.2  and  (3.211).  Hence  uniformly  in  X, 
(5.9)  Var[JN(X)]  = 0( N"p),  p = 1 - (2b/a)tn  3. 

The  result  follows  by  (5.8)  and  (5.9). 
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